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Sharing Line Bandwidth Among Virtual Cmcurrs 

IN AN ATM Device 

Related Application 

The present application is related to the commonly assigned co-pending US 
application entitled, "A method for scheduling data for communication on a digital 
subscriber line". Serial Number: 09/569,907, Filed: Mayll, 2000. 

Background of the Invention 

Field of the Invention 

The present invention relates to telecommunication networks, and more 
specifically to a method and apparatus for sharing line bandwidth among virtual circuits 
in an asynchronous transfer mode (ATM) device. 

Related Art 

Asynchronous transfer mode (ATM) based networks generally contain several 
ATM devices (e.g., switches, edge routers) connected by communication paths. Each 
path is generally characterized by an amoimt of bandwidth ("line bandwidth"), which is 
shared by several virtual circuits as is well known in the relevant arts. 

Such sharing needs to be implemented while meeting/balancing various 
requirements. For example, it is generally desirable that certain types of virtual circuits 
(e.g., of constant bit rate type) be provided higher priority than certain other types of 

0 
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virtual circxiits (e.g., of available bit rate type). ATM standards may specify such 
priorities. 

Another generally desirable feature is support for over-subscription. Over 
subscription generally refers to a situation in which the aggregate allocated bandwidth for 
all virtual circuits active on a path exceeds the line bandwidth of the path. 

Brief Description of the Drawing s 

The present invention will be described with reference to the accompanying 
drawings, wherein: 

Figure 1 is a block diagram illustrating an example environment in which the 
present invention can be implemented. 

Figure 2 is a flow chart illustrating a method in accordance with the present 
invention. 

Figures 3 A and 3B together represent a flow chart illustrating the manner in which 
cells related to different virtual circuits may be scheduled for transmission according to 
an aspect of the present invention. 

Figure 4A is a table illustrating the manner in which cells are scheduled for 
transmission when the bandwidth on a path is not over-subscribed in an embodiment of 
the present invention. 

Figure 4B is a table illustrating the manner in which cells are scheduled for 
transmission when the bandwidth on a path is over-subscribed in an embodiment of the 



Patent 



Page 3 of 46 



CSCO-031/7427 



present invention. 

Figure 4C is a table illustrating the manner in which peak cell rate (PGR) can be 
enforced according to an aspect of the present invention. 

Figure 5 is a block diagram illustrating the details of an embodiment of an ATM 
5 device provided according to an aspect of the present invention. 

Figure 6 is a block diagram illustrating the details of an embodiment of an ATM 
device implemented substantially in the form of software according to an aspect of the 
present invention. 

In the drawings, like reference niunbers generally indicate identical, functionally 
10 similar, and/or structurally similar elements. The drawing in which an element first 
appears is indicated by the leftmost digit(s) in the corresponding reference number. 

Detailed Description of the Preferred Embodiments 
1. Overview and Discussion of the Invention 

An ATM device implemented according to an aspect of the present invention 
15 enables over-subscription while limiting bandwidth usage by each virtual circuit to 
corresponding allocated bandwidth and enforcing priorities as specified by ATM 
standards. That is, a queued cell on a virtual circuit with allocated bandwidth is not 
scheduled for transmission until the turn of the virtual circuit arrives according to the 
allocated bandwidtii. In addition, cells related to CBR, VBR-RT, VBR-nRT and UBR 
20 VC-types (virtual circuit typ^) are scheduled for transmission in that priority, as specified 
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by ATM standards. 

In an embodiment described below, such features are attained by maintaining 
counters which indicate a number of cells that may need to be transmitted for each virtual 
circuit according to the corresponding allocated bandwidth and the VC-type (virtual 

5 circuit type), A cell on a virtual circuit with allocated bandwidth is transmitted only if the 
associated counter has a positive value (i.e., one or more). If multiple virtual circuits have 
counters with positive value, cells related to VC-types of higher priority are transmitted 
on the shared path. Cells related to VC-types with no allocated bandwidth (e.g., UBR) 
are transmitted only if the counters related to virtual circuits with allocated bandwidth are 

10 equal to zero. 

Several aspects of the invention are described below with reference to example 
environments for illustration. It should be understood that numerous specific details, 
relationships, and methods are set forth to provide a fall understanding of the invention. 
One skilled in the relevant art, however, will readily recognize that the invention can be 
1 5 practiced without one or more of the specific details, or with other methods, etc. In other 
instances, well-known structures or operations are not shown in detail to avoid obscuring 
the invention. 

2. Example Environment 

Figure 1 is a block diagram illustrating an example environment in which the 
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present invention can be implemented. The environment is shown containing personal 
computer (PC) system 110- A, IP phone 110-X, network 150, and server 170. Each 
component is described below in further detail. 

PC 1 10- A accesses server 170 and IP phone 1 10-X may be used to place a voice 
call using network 150. As may be appreciated, CBR type virtual circuits may be suitable 
for voice calls and UBRA'BR virtual circuits are suitable for PC accesses. In general, the 
environment may contain several devices, each with potentially different requirements 
(in terms of virtual circuit type, QoS parameters, etc.). 

Network 1 50 provides connectivity between various devices using an appropriate 
protocol. Network 150 is shown containing customer premise equipment (CPEs) 120- A 
through 120-N, telephone lines 123- A through 123-N, digital subscriber loop access 
multiplexor (DSLAM) 130, switch 140 and edge router 160. PC 1 10-A and IP phone 
1 10-X are shown connected to CPE 120-A by a local area network (LAN) 1 12. 

The environment is shown containing only a few representative components for 
illustration. In reality, each environment typically contains many more components. CPE 
120-A through 120-N are described with reference to CPE 120-A only for conciseness. 
Similarly, telephone lines 1 23- A through 1 23-N are described with reference to telephone 
line 123-A. CPE-120-A, switch 140 and edge router 160 are examples of ATM devices. 
The operation of the various devices in network 150 is described below in further detail. 
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CPE 1 20- A receives data packets generated by applications executed in PC 1 1 0- A 
through 1 10-N on LAN 1 12, and forwards the received data packets (ATM cells) to 
DSLAM 130. CPE 120- A receives data packets from DSLAM 130 (on 123- A), and 
forwards (the data in) each received packet to an appropriate user system. In one 
embodiment, the communication between PC/IP phone and CPE 120- A is implemented 
using Internet Protocol (IP), in the paths from CPE 1 20-A to edge router 1 60 using ATM, 
and between edge router 160 and server 170 using IP. 

DSLAM 130 receives data packets (e.g., ATM cells) from CPEs 120-A through 
120-N, and sends the received packets to switch 140. Similarly, DSLAM 130 receives 
packets from switch 140, and sends the received packets to a corresponding CPE (on a 
corresponding telephone line). 

Switch 140 may receive ATM cells from both DSLAM 130 and edge router 160. 
The ATM cells received from user systems (via corresponding CPE and DSLAM 130) 
are forwarded to edge router 160 and cells from edge router 160 are forwarded to 
DSLAM 130 (generally based on the ATM header). 

Edge router 160 receives ATM cells from switch 140, combines the payload in 
multiple cells into a single IP packet, and forwards each IP packet to server 170. 
Similarly, data m packets from server 170 may be packaged into multiple cells, and the 
cells are forwarded to switch 140. 
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From the above, it may be appreciated that virtual circuits may be set up between 
CPE 120-A and edge router 160 at least to support the data transfers noted above. Each 
of the ATM devices (CPE, DSLAM, switch and edge router) may be in the path of many 
vutual circuits. As noted above in the backgroimd section, the virtual circuits may need 
to be supported while supporting various requirement. The manner in which virtual 
circuits may be supported according to various aspects of the present invention is 
described below in further detail. 

3. Method 

Figure 2 is a flow chart illustrating a method in accordance with the present 
invention. The method is described below with reference to switch 140 of Figure 1 for 
illustration. However, the method may be implemented in other devices and other 
environments as well. The method begins in step 201, in which control immediately 
passes to step 210. 

In step 210, switch 140 permits over-subscription in allocation of bandwidth to 
virtual circuits. As noted in sections above, over-subscription refers to a scenario in 
which the sum of allocated bandwidths (for virtual circuits) on a path exceeds the Ime rate 
of the path. Thus, switch 140 is implemented to accept configuration (manually by an 
administrator and/or automatically by signaling protocols) of a virtual circuit even if the 
allocated bandwidth would cause the sum of allocated bandwidths to exceed the line rate 
of the path. 
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In step 230, switch 140 receives cells related to various virtual circuits. For 
illustration, it is assumed that cells related to several VC-types (CBR, VBR RT, VBR 
nRT and UBR) are received. In case of some devices (e.g., edge routers and CPEs), 
frames may be received, which in turn are fragmented into cells in a known way. The 
5 cells thus generated may be received by appropriate component in the edge router/CPE. 

In step 250, switch 140 schedules (shapes) cells while enforcing to ATM specified 
priorities and limiting bandwidth usage by each virtual circuit to any corresponding 
allocated bandwidth. As is well known, ATM standards generally specify that cells 
related to CBR, VBR-RT, VBR-nRT and UBR VC-types (virtual circuit type) be 
1 0 scheduled for transmission in that priority. 

In addition, CBR and VBR type virtual circuits are characterized by associated 
allocated bandwidths (which are specified by the corresponding QoS parameters). Switch 
140 forwards the cells for each (CBIWBR) virtual circuit, while ensuring that the 
bandwidth usage (by the virtual circuit) does not exceed the allocated bandwidth. The 
1 5 method then ends in step 299. 

The description is continued with the manner in which step 250 may be 
implemented with examples. 
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4. Cell Scheduling or Traffic Shaping 

Figures 3 A and 3B together represent a flow chart illustrating the manner in which 
transmission of cells may be sequenced to meet the various features noted above with 
reference to steps 210 and 250. The method is again described with reference to Figure 
1 for illustration. However, the method can be implemented in other environments as 
well. The method begins in step 301m which the control immediately passes to step 310. 

In step 310, VC-type and corresponding QoS parameters for each virtual circuit 
are received. As is well known, the QoS parameters depend on the VC-type. For 
example, CBR VCs are characterized by peek cell rate (PGR); VBR VCs are 
characterized by PGR, sustained cell rate (SGR), and maximum burst size (MBS); and 
UBR VCs are optionally characterized by PGR. In general, the QoS parameters are 
received when the corresponding virtual circuit is provisioned/configured. 

In step 315, the inter-cell delay is computed for each of the VCs. Inter-cell delay 
generally represents the delay between two consecutive cells in the ideal scenario. Thus, 
in case of virtual circuits with allocated bandwidths (PGR in case of CBR, and SCR in 
case of VBR), the inter-cell delay is inversely proportional to the corresponding allocated 
bandwidth. In an embodiment, the inter-cell delay is computed according to the equation: 
[(line rate x token value)/SGR], wherein *x' represents multiplication operator, token 
value is chosen as 100, and 7' represents division operator. 



Patent 



Page 10 of 46 



CSCO-031/7427 



In step 320, counters (line slot credit and VC-credit) are initialized to zero for each 
virtual circuit. Line slot credit is used to determine whether the corresponding virtual 
circuit's turn has arrived for transmission of a cell. VC-credit generally represents the 
additional cells that need to be transmitted for the VC consistent with the allocated 
bandwidth and the VC-type as described below in further detail. 

In step 325, the line slot credit is incremented by a token value for each virtual 
circuit. In an embodiment, the token value is equated to the duration of a cell slot, and 
several computations related to time are performed using the token value. 

In step 330, a determination is made as to whether the slot credit for a VC is 
greater than or equal to the inter-cell delay. Control is transferred to step 333 if line slot 
credit is greater than or equal to inter-cell delay, or else control is transferred to step 345. 
It may be appreciated that steps 325, 330, 333, 335 and 340 are repeated for each virtual 
circuit as applicable. 

In step 333, a determination is made as to whether the VC-credit of each VC is 
equal to the corresponding maximvmi value. In the C2ise of CBR virtual circuits, the 
maximum value is always equal to L In the case of VBR virtual circuits, the maximimi 
value may be computed according to the equation [MBS - (MBS x SCR/PCR) - 1], 
wherein and *x* respectively represent a subtraction and multiplication operation, and 
MBS, SCR and PCR represent corresponding QoS parameters, as noted above. 
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Control passes to step 345 if the VC-credit is equal to the corresponding maximum 
value, and to step 335 other wise. In step 335, the VC-credit of the corresponding VC is 
incremented. In step 340, the value of line slot credit is decremented by the 
corresponding value of inter-cell delay determined in step 315. 

5 It may be appreciated that the steps described above set up various counters, which 

are used to determine the next cell to be transferred. The remaining steps described below 
operate to use the counters to determine which cell to transfer in the present cell slot. 

In step 345, a determination is made as to whether there is a CBR VC with pending 
cells and with VC-credit of 1 . If there is such a VC, control is transferred to step 350, or 
10 else to step 360. In case of more than one VC satisfying such a criteria, one of the VCs 
may be selected, for example, in a round-robin fashion. In step 350, the next available 
cell corresponding to CBR VC is scheduled for transmission. In step 355, VC-credit is 
set equal to '0' and the control is transferred to step 325 to determine the cell for 
transmission in the next cell slot. 

15 Steps 360 and 365 are performed similar to steps 345 and 350 respectively, but for 

VBR-RT virtual circuits. In step 370, the VC-credit is decremented by one (since the 
maximum value can be greater than 1). Control then passes to step 325. Steps 375, 380 
and 385 are performed similar to steps 360, 365 and 370 respectively, but for VBR-nrt 
virtual circuits. 
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In step 390, switch 140 determines whether there is a UBR VC with any pending 
ceils. If there is such a virtu2d circuit, the next pending cell on that virtual circuit is 
scheduled for transmission assunung a PGR not specified associated with the UBR VC. 
The manner in which PCR parameters may be handled for all applicable type of virtual 
circuits is described in sections below. 

In step 398, if the UBR VC has no pending cells, an idle cell may be scheduled for 
transmission in the corresponding cell slot to maintain synchronization. Control is then 
transferred to step 325. Steps 325 through 385 may be implemented for each cell slot to 
determine the next cell for transmission. 

It should be appreciated that the processing is performed for CBR, VBR-RT, VBR- 
nRT, and UBR in that sequence, thereby implementing the priority specified by the ATM 
standard. The description is continued with reference to some examples for illustrating 
the approaches described above. 

5. Allocating Slots to Virtual Circuits 

Figure 4A is a table illustrating allocation of cell slots when a single VC is 
provisioned in a non-over-subscription scenario. The table is shown containing columns 
401-408 for the corresponding eight cell slots, and rows 441-446 respectively 
representing line slot credit, cell slot, line slot balance, cell spacing, transmitted cell, and 
VC credit. Each row and colimfm are described below in further detail. 
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The contents of the table are designed assuming a line rate of 640 Kbps and a 
single (idle, i.e., no cells avsiilable for transmission) VBR-nRT VC having QoS 
parameters of (PGR = 448Kbps, SCR = 320Kbps, MBS = 14 cells). The line inter-cell 
delay of the VC may be computed to equal [(640 * 100) / 320 = 200 units], wherein 100 
5 represents the chosen token value. The maximum burst VC credit for the PVC may be 
computed according to the formula: [MBS - (MBS x SCR / PCR) -1], as noted above. 
Thus, the maximum burst VC credit for the VC equals (14 - (14 x 320/448) - 1) = 3. 

With respect to the colximns, each column represents the relevant values in a 
corresponding of the cell slots 40 1 through 408 . Line slot credit 44 1 represents a present 
10 total credit value for a virtual circuit, and is generated by incrementing the entry in line 
slot balance 443 for the previous cell slot (as in step 325). Thus, the values (200, 100, 
200, 100, 200, 100, 200) in colunms 402-408 of line slot credit 441 are respectively 
generated by adding 100 (token value) to the values (100, 0, 100, 0, 100, 0, 100, 0) in 
columns 401-407 of line slot balance 443. 

15 VC credit 446 is incremented by 1 (as in step 335) if the corresponding line slot 

credit is greater than or equal to the inter-cell delay (colunms 402, 404 and 406) imless 
the VC credit value already equals the maximum permissible value (colunm 408). VC 
credit 446 is decremented by 1 when a cell is transmitted on the corresponding VC in a 
previous cell slot (as illustrated below with reference to Figures 4B and 4C). As the VC 

20 in the subject example is assumed to be idle, no instances of decrementing are shown. 
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In general, the next pending cell on a virtual circuit is considered ready for 
transmission if the VC credit for the virtual circuit is greater than or equal to one. In 
addition, VC credit generally represents the backlog (for each virtual circuit) computed 
according to allocated bandwidth, but the upper limit is determined by the VC-type. 

The entries for line slot balance 443 are generated by deducting the inter-cell delay 
from line slot credit 441 in the same colunm when VC credit is incremented by one (as 
in step 335), otherwise the line slot balance equals the line slot credit of the same column. 
Thus, when VC credit is shown incremented in cell slots 402, 404, 406 and 408, the 
corresponding entries of line slot balance 443 are shown equaling 0 (200 in line slot credit 
row less the inter-cell delay of 200). In the remaining columns (401, 403, 405 and 407), 
the line slot balance is shown equaling the line slot credit value. 

Cell slot 442 indicates the cell slots in which the cells for a virtual circuit would 
need to be transmitted according to the allocated bandwidth without consideration of 
other criteria (such as priorities, etc.). As the allocated bandwidth (SCR) equals half the 
line rate, alternate entries are marked with VCl. Cell spacing 444 mdicates the virtual 
circuits that would be candidates for allocation of the cell slot according to the allocated 
bandwidth. Since a single VC is considered in Figure 4A, the values in this row equals 
the values in cell slot 442. 



Transmitted cell 445 indicates the virtual circuit which is allocated the 
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corresponding cell slot. As the VC is assumed to be idle, all entries are marked idle (i.e., 
idle cell is scheduled for transmission). However, after cell slot 408, three of the cells 
received on the VC would be permitted to be transmitted at the corresponding PCR rate 
(allocated bandwidth in case of CBR VC) as the VC credit equals 3 in cell slot 408. 

Thus, it may be appreciated that the approach described above implements the 
ATM specifications when a conmiunication path is not over-subscribed. The description 
is continued with respect to an example in the over-subscribed scenario. For 
understanding. Figure 4B illustrates the manner in which scheduling is performed while 
enforcing ATM-specified priorities and allocated bandwidths. Figure 4C illustrates the 
manner in which the approach can be extended to enforce PCR specified limits on 
VBR/UBR type virtual circuits. 

Figure 4B contains a table illustrating the scheduling of cells in a over-subscription 
scenario. The table contains data related to times slots 451-460. The table is designed 
assuming a scenario in which the line rate equals 640 Kbps, and that a CBR VC (with 
PCR =512 Kbps) and a VBR-nRT VC (with PCR, SCR and MBS respectively equaling 
448 Kbps, 320 Kbps, 14) share the same path. As may be appreciated, this represents a 
over-subscribed scenario in which the total allocated bandwidth (512 + 320) exceeds the 
line-rate. 

Continuing with the description, assuming a token value of 100, inter-cell delay 
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for the CBR VC is computed by [(640 * 1 00) / 5 1 2 = 1 25], and the inter-cell delay for the 
VBR-nRTVCis computed by[(640* 100)/320 = 200]. Rows 46 1-463 and 469- A relate 
to CBR VC, and rows 464-466 and 469-B relate to VBR-nRT VC. The rows with similar 
labels as in Figure 4A are used similarly. 

Cell slot 462 indicates that the CBR VC would be a candidate for allocation of cell 
slots 452-455 and 457-460 based on the entries in line slot credit 46 1 and line slot balance 
463. Similarly, cell slot 465 indicates the VBR-nRT VC would be a candidate for 
allocation of cell slots 452, 454, 456, 458 and 460. 

Thus, in cell spacing 467 row, an idle cell is shown to be candidate for scheduling 
in cell slot 45 1 (cells of neither VC transmitted), the CBR VC is indicated to be exclusive 
candidate for transmission in cell slots 453, 455, 457, and 459, the VBR-nRT VC is 
indicated to be exclusive candidate for scheduling in cell slot 456, and both VCs are 
indicated to be candidates in cell slots 452, 454, 458 and 460. 

In case a VC is indicated as exclusive candidate for transmission in a cell slot and 
if there is a pending cell on the virtual circuit, a cell of that VC is scheduled for 
transmission, as depicted in cell slots 453 and 456 of transmitted cell 468 row. However, 
when multiple VCs are candidates for transmission, the CBR VC is provided higher 
priority (compared to VBR nRT) as depicted in cell slots 452 and 454. In cell slots 455, 
457 and 458, a cell related to VBR nRT is shown transmitted because it is assimied that 
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a cell for the CBR VC is not pending in that cell slot (and there is a pending cell on VBR 
nRT VC). 

An idle cell is shown scheduled for transmission in cell slot 459 assuming that no 
new cells are received for CBR VC (even if there is a pending cell on VBR nRT VC since 
5 the corresponding VC credit 469-B equals zero). Assuming that additional CBR cells are 
not received again (or pending), a pending cell of VBR nRT is shown transmitted in cell 
slot 460 (even though CBR VC also is a candidate). 

Each value in VC-credit rows 469-A and 469-B is incremented by 1 if the 
corresponding line slot credit is equal to or greater than the line intercell delay, and 
1 0 decremented by 1 if a cell for the virtual circuit is scheduled for transmission in the same 
cell slot, while ensuring that the VC-credit does not exceed any corresponding maximum 
value. The incrementing and decrementing are illustrated below with reference to the 
entries in VC-credit row 469-B for VBR nRT virtual circuit. 

The first cell slot 45 1 of VC credit row 469-B is shown starting with a 0, and the 
1 5 entries thereafter are shown with a convention A+B-C = D, wherein A represents a value 
from a previous cell slot of the same row, B represents 1 if the line slot credit in the same 
cell slot (colunm) is greater than or equal to the line intercell delay (otherwise 0), C 
represents 1 if a cell is scheduled for transmission in the present cell slot, D represents the 
results of addition and subtraction (and would equal the value of A for the next cell slot). 
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and and respectively represent the symbols for addition and subtraction. 

It may be appreciated that the above described approach provides several features. 
For example, over-subscription is supported because the two VCs of Figure 4B can co- 
exist and operate to transfer respective cells. Prioritization may be implemented across 
several VC types (e.g., in cell slots 452 and 454, CBR VC is given higher priority 
compared to VBR nRT VC). The approach limits the bandwidth usage according to the 
allocated bandwidth (e.g., cells related to VBR nRT are not transmitted in cell slot 459 
even if pending). 

Thus, it may be appreciated that the approach(es) of above enable an ATM device 
to support over-subscription while enforcing ATM specified priorities and also limiting 
bandwidth usage by each virtual circuit to a corresponding allocated bandwidth. In 
addition, the approach(es) may need to limit the bandwidth usage by each virtual circuit 
(e.g., UBR and VBR types) to any corresponding PGR (peak cell rate) limits. The 
manner in which the approaches of above be extended to support PGR imposed 
constraints is described below. 

6. Enforcing PGR Gell Rate 

The extensions/modifications that may be performed to the flow-charts of Figures 
3 A and 3B to enforce peak cell rate (PGR) on each virtual circuit are described first. The 
description is then continued with reference to Figure 4G, which illustrates how the PGR 
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enforcement may change allocation of cell slots in relation to the scenario of Figure 4B 
described above. 

With respect to the extensions/modifications, in addition to "intercell delay" of 
step 320, a "peak intercell delay" may be computed associated with each of VBR and 
5 UBR virtual circuits having an associated PCR. The peak intercell delay may be 
computed according to the equation [peak intercell delay = (line rate x token value) / 
PCR] , wherein the same value ( 1 00) used with respect to computations above can be used 
for token value. 

With respect to the initializations of step 320, a variable "peak slot credit" may be 
1 0 maintained for each virtual circuit and initialized to 0. Another variable "peak maximum 
slot credit" may be computed according to the equation [token value x ( 1 + floor( (peak 
intercell delay - 1) / 100)]. With respect to the incrementing of step 325, peak slot credit 
is also incremented by token value in the same step, but is capped at peak maximum slot 
credit. 

15 With respect to scheduling for transmission, in addition to the respective 

comparisons/conditions of steps of 360, 375 and 390, an additional check may be 
performed to determine whether peak slot credit is greater than or equal to peak intercell 
delay. The cell for a virtual circuit is scheduled for transmission only if the additional 
check returns a positive result. 
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Once a cell related to a virtual circuit is scheduled for transmission, the peak slot 
credit counter for the virtual circuit is decremented by the corresponding peak intercell 
delay. The modifications of above operate to enforce PGR on associated virtual circuits 
as illustrated below in further detail with reference to Figure 4C. 

Figure 4C is a table illustrating the scheduling of cells when PGR is also enforced 
as described above. For illustration, it is again assumed that the line rate equals 640, a 
furst virtual circuit (VGl) is of GBR type with an allocated bandwidth of 512, a second 
virtual circuit (VG2) is of VBR-nRT type with PGR, SGR and MBS respectively equaling 
448 Kbps, 320 Kbps, 14. Again, the sum of the allocated bandwidths exceeds the line 
rate, i.e., (512 + 320 > 640). 

The line intercell delays of the two circuits respectively equal 1 25 and 200 as noted 
above. The peak intercell delay and peak maximum slot credit for the VBR virtual circuit 
are respectively computed by the below equations, 
peak intercell delay = (640'^ 100) / 448 = 142; 
peak maximum slot credit = 100 * ( 1+ floor[(142 -1)/100] ) = 200 

Gontinuing with reference to Figure 4G, coliunns 471-480 represent the status of 
various coxmters in the corresponding cell slots. Rows 481-491 represent the status of 
various counters (some of them shown merely for understandability) in the corresponding 
cell slots. Rows 481-487 operate similar to rows 461-467 of Figure 4B, and the 
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differences are described briefly below. The remaining rows 488-491 are also briefly 
described below. 

Peak slot credit 488 is generated by adding token value (100) to the value in 
previous cell slot of peak slot balance 490 (shown in columns 472, 476-480), but the 
5 maximum value is capped at peak maximum slot credit (shown in columns 473-475 and 
478). In addition, a cell for the VBR-nRT is scheduled for transmission only if peak slot 
credit 488 is greater than or equal to peak intercell delay (142). 

Thus, transmitted cell row 489 is depicted as scheduling an idle cell in cell slots 
477 and 480 even if a pending cell is present for VBR-nRT since the peak slot credit 488 
10 is less than peak intercell delay (and represents a difference from the operation depicted 
in Figure 4B, cell slots 457, 459 and 460). However, the pending cell is shown 
transmitted in the immediate cell slot 478 as peak slot credit 488 is shown with a value 
of 200 (more than peak intercell delay of 142). 

Each entry of peak slot balance 490 equals the value in peak slot credit 488 of the 
1 5 same cell slot if a VBR nRT cell is not transmitted (shown in cell slots 47 1 -474, 477, and 
480), or else equals peak intercell delay (142) less the value in peak slot credit 488 
(shown in cell slots 475, 476, 478 and 479). 

VC credit coimter 49 1 (for VBR nRT) operates similar to VC credit counter 469-B, 
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and the same convention of (A+B-C=D, described above) is used to represent each entry 
after the first cell slot. The differences in values are briefly described now. It may first 
be noted that an idle cell is transmitted (instead of a cell of the VBR nRT virtual circuit) 
in cell slots 477 and 480 (because peak slot credit is less than peak intercell delay). As 
5 a result, the entry in cell slot 477 and 479 is not decremented and thus remains at a value 
of 1 (compared to a value of 0 in row 469-B of Figure 4B). 

Thus, it may be appreciated that the credits based approach can be extended to 
enforce PGR constraints as well. The description is continued with reference to the 
manner in which example ATM devices may be implemented according to various 
1 0 aspects of the present invention, 

7. ATM Device 

Figure 5 is a block diagram illustrating the ATM devices may be implemented 
according to various aspects of the present invention. ATM device 500 is shown 
containing inboimd interfaces 5 10- A, 510-B, and 510-C, queuing block 520, VC tables 
15 530, port queues 540-A, 540-B, and 540-C, scheduler blocks 550-A, 550-B, and 550-C 
and outbound interfaces 590-A, 590-B, and 590-C. Each block is described below in 
further detail. 

Each of the inbound interfaces 5 10- A, 510-B, and 510-C provides physical, 
electrical and protocol interface to receive ATM cells on a corresponding path. The 
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received cells may be forwarded to queuing block 520. Similarly, outboimd interface 
590- A, 590-B, and 590-0 provides physical, electrical and protocol interface to transmit 
ATM cells on a corresponding path. Both interfaces may be implemented in a known 
way. 

5 VC tables 530 may contain various pieces of information required to process each 

received cell. For example, one table may specify a mapping of {inbound VP WCI and 
inbound interface} to {outbound VP WCI and outbound interface} . Similarly, the VC- 
type and corresponding QoS parameters for each active VC may also be contained in VC 
tables. In general, the QoS parameters are stored when a configuration for a virtual 

10 circuit is accepted. VC tables may be populated manually by the administrator of an 
ATM device (switch 140) or by appropriate signaling protocols. 

Queuing block 520 places each received cell on a corresponding VC-queue in one 
of port queues 540-A through 540-C. To implement such a task, the inbound VP WCI 
and the specific port/interface on which the cell is received is mapped to the 
15 corresponding outbound VP WCI and the specific one of the port queues by accessing 
VC tables 530. 

The outbound VP WCI may replace the inbound VP WCI in each cell, and the 
resulting cell is placed on the determined one of the port queues. While queuing block 
530 is shown shared by all the inboimd interfaces, potentially a dedicated queuing block 
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may be implemented with each inboimd interface. On the other hand, a single scheduler 
block may be shared for all the outbound interfaces. 

Each of the port queues 540-A, 540-B, and 540-C may contain a queue 
corresponding to each VC supported on the corresponding outbound interface. The 
5 queues may be implemented using data structures such as linked lists and using 
appropriate memory xmits. 

Each of scheduler blocks 550- A, 550-B, and 550-C determine the specific one of 
the pending cells (on all VCs) on the corresponding one of port queues 540-A, 540-B, and 
540-C. The approach(es) described above may be used to make such a determination for 
10 each port queue. The determined cells are transmitted by the outbound interfaces. 

Thus, an ATM device according to Figure 5 may support virtual circuits according 
to various aspects of the present invention. While ATM device 500 may correspond to 
an ATM switch, the implementation of the above-described features in CPEs and edge 
routers will be apparent to one skilled in the relevant arts by reading the disclosvire 
1 5 provided herein. 

It should be xmderstood that each of the blocks of Figure 5 can be implemented in 
a combination of one or more of hardware, software and firmware. When cost is of 
primary consideration, the implementation is performed more in software (e.g., using a 
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processor executing instructions provided in software/firmware). Cost and performance 
can be balanced by implementing ATM devices with a desired mix of hardware, software 
and/or firmware. An embodiment implemented substantially in software is described 
below. 

8. Software Implementation 

Figure 6 is a block diagram illustrating the details of ATM device 600 in one 
embodiment of the present invention. ATM device 600 is shown containing processing 
unit 610, random access memory (RAM) 620, storage 630, output interface 660, packet 
memory 670, network interface 680 and input interface 690. Each component is 
described in further detail below. 

Output interface 660 provides output signals (e.g., display signals to a display unit, 
not shown) which can form the basis for a suitable user interface for an administrator 
(configuring ATM device 600) to interact with ATM device 600. Input interface 690 
(e.g., interface with a key-board and/or mouse, not shown) enables an administrator to 
provide any necessary inputs. 

Network interface 680 enables ATM device 600 to send and receive data on 
commimication networks using asynchronous transfer mode (ATM) and/or intemet 
protocol (IP). Network interface 680, output interface 660 and input interface 690 can 
be implemented in a known way. 
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RAM 620 receives instructions on path 650 from storage 630, and provides the 
instructions to processing unit 610 for execution. Packet memory 670 stores (queues) 
cells/packets waiting to be forwarded (or otherwise processed) on different ports. RAM 
620 may be used to store the various VC tables as well. RAM 620 and packet memory 
670 may each be implemented as multiple units of memory and/or share the same 
memory unit(s). 

Secondary memory 630 may contain imits such as hard drive 635 and removable 
storage drive 637. Secondary storage 630 may store the software instructions and data, 
which enable ATM device 600 to provide several features in accordance with the present 
invention. In an embodiment, VC tables 530 may be implemented using RAM 620, 
storage 630 and secondary memory 630. 

Some or all of the data and instructions may be provided on removable storage imit 
640, and the data and instructions may be read and provided by removable storage drive 
637 to processing unit 610. Floppy drive, magnetic tape drive, CD-ROM drive, DVD 
Drive, Flash memory, removable memory chip (PCMCIA Card, EPROM) are examples 
of such removable storage drive 637. 

Processing unit 610 may contain one or more processors. Some of the processors 
can be general puipose processors which execute instructions provided from RAM 620. 
Some can be special purpose processors adapted for specific tasks (e.g., for 
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• 



memory/queue management). The special purpose processors may also be provided 
instructions from RAM 620. In general, processing unit 610 reads sequences of 
instructions from various types of memory medium (including RAM 620, storage 630 and 
removable storage unit 640), and executes the instructions to provide various features of 
5 the present invention. 

9. Conclusion 

While various embodiments of the present invention have been described above, 
it should be understood that they have been presented by way of example only, and not 
limitation. Thus, the breadth and scope of the present invention should not be limited by 
10 any of the above-described exemplary embodiments, but should be defmed only in 
accordance with the following claims and their equivalents. 



Patent 



Page 28 of 46 



CSCO-031/7427 



